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(57) Abstract 

The present invention provides a system and method for detecting non-conforming cigarette packages during the actual fabrication 
process. A digital camera (205) is placed in close proximit>' to the blank feeding and folding turrcnt area of a cigarette packaging machine 
assembly. Prior to the cigarette package being completely formed, the camera captures a digital image of three sections of the pack blank, 
namely the dust flaps and the inside front face. The camera is used to visually inspect the pack blank for mis-folded or partially or 
completely missing dust flaps and a reversed pack blank. The captured image is transferred to a processor (225) which compares the pixel 
value of the three sections of the pack blank to a predetermined pixel value. If the comparison indicates that the pixel value of any of 
the three sections does not equal the predetermined pixel value which means that one or more of the dust flaps are either mis-folded or 
partially/completely missing or that the blank is reversed, the cigarette package is registered as non-conforming. 
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SYSTEM AND METHOD FOR VISUALLY INSPECTING 
A CIGARETTE PACKAGING PROCESS 



BACKGROUND 

The present invention relates generally to cigarette packaging machines 
5 and, more particularly, to a system and method for visually inspecting cigarette 
packages during the fabrication process. 

In cigarette manufacturing, quality control has become a matter of 
increasing attention. Poor packaging (i.e., packaging which does not conform 
with predetermined quatiiy requirements) detracts from consumer perceptions of 
10 the quality of the packaged goods. Perfectly good items are routinely returned for 
refund and disposal if they are poorly packaged. On-line inspection during 
manufacture is one way of controlling packaging non-conformities. In an effort to 
enhance the on-line quality control capabilities of their production machines, many 
companies have turned to machine vision techniques wherein cameras are used to 

15 allow for inspection of the production process. 

In the field of cigarette packaging, conventional vision inspection machines 
focused on inspecting the cigarette packages after the packages have already been 
formed. In U.S. Patent No. 5,101,609, issued to Cook, a vision inspection system 
is disclosed in which a cigarette packaging machine is modified to include an 
20 inspection indexing wheel. The inspection indexing wheel is positioned at a post- 
construction location along the manufacturing process at which the cigarette 
packages have already been ftilly constructed. Such systems are wasteful of 
packaging material and make die recovery of product more difficult. In those 
instances where a manufacmring machine is repeatedly producing non-conforming 
25 packages, these conventional vision inspection systems, such as the one described 
in Cook, do not assist the manufacturer in identifying where in the fabrication 
process correction is needed. - 
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There .exists a need ifor^ a vision inspection system which inspects cigars 
packages during the actual fabrication process. • . ^ 

SUMMARY OF THE INVENTION _ 

5 The present invention seeks to overcome the above-identified deficiencies 

of the prior art by, providing a, system and method of detecting non-conforming 
cigarette packages during the actual fabrication process.^ According to exemplary 
embodiments, a digital camera is placed in close proximity to the blank feeding 
and folding turret area of a cigarette packaging machine assembly. At a location 

10 where the cigarette package is partially constructed,, the camera captures a digital 
image of three sections of the pack blank, namely the dust flaps and the inside 
front panel. The output- of the camera is used to visually inspect the pac^k blank 
for mis-folded or partially or completely missing dust flaps and a reversed, pack 
blank. The capmred image is transferred to a processor which compares the pixel 

15 value of the three sections of the pack blank to a predetermined pixel valiie. If the 
comparison indicates that the pixel value of any of the three sections does not 
equal the predetermined pixel value which means that one or more of the dust flaps 
aire either .mis-folded or partially /completely missing or that the blank is reversed, 
the cigarette package is registered as a non-conforming item. Visually inspecting 

20 the blank prior to completion of the cigarette package allows for the cigarettes 
within the non-conforming package to be more, easily recycled, and aids in 
diagnosing problems in the actual, cigarette packaging process. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The above objects and features of the present invention will be more 
25 apparent from the following description of the .preferred embodiments with 
reference to the accompanying drawings, wherein: 
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" ' Figure 1' illustrates an exemplary cigarette paclca'ging process, as 

implemented in a Focke 350 Round Corner FTB packer*,- into which the vision • 
inspection technique of the present invention may be employed; 

Figure 2 illustrates the vision inspection system of the present invention as 
implemented in the exemplary cigarette packaging assembly of Figure 1; 

Figure 3 illustrates an exemplary image captured by the vision' inspection 
system of the present invention; — - • 

*" Figifre 3. 1 illustrates the inspection areas of an exemplary, conforming 
pack blank; ' ^ ^ . . . ■ « . 

Figure 3.2 illustrates the inspection areas of an exemplary, non-confofming: 
pack blank; and - ' . - 

* Figures 4. rand 4.2 illustrate exemplary round" comer and square corner 
pack blanks. . 

DETAILED DESCRIPTION OF THE INVENTION 

Toward increasing quality control in a cigarette packaging process, the 
present invention provides a machine vision inspection system so as to'allow for 
monitoring of the actual process. By placing a fcamera in close proximity to-an 
- area of the cigarette packaging assembly in which a'large number of nbn- - 
conformities commonly occur, non-conforming packages can be readily identified 
and rejected and the cause of reoccurring non-conformities can be corrected. 

Figure 1 illustrates an exemplary cigarette packaging process, as 
implemented in a Focke 350 Round Corner, hinge lid packer, into which the 
vision inspection technique of the present invention may be employed, among 
other similarly arranged* machines. At stage 1 of the packaging process, a 
plurality of cigarettes are grouped together so'as to form a bundle. Each bundle 
commonly includes a group of 20 cigarettes. At'stage 2, each bundle is then 
individually wrapped in a foil wrapper. A cardboard insert is placed adjacent to 
each foil-wrapped bundle at stage 3. The bundles are then routed to a blank 
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feeding and folding turfet.:area^<siage.4) where.a blank. is fonned;around each of 
the foil-wrapped bundles to form an individual cigarette. package. The cigarette 
packages are then routed to first and. second drying drums (stages 5 and 6, . 
respectively) where the glued packages are allowed to dry prior to being placed in 
cigarette cartons. ; . >. ... • - " . . . : . 

The present invention seeks; to identify packaging non-conformities 
commonly associated with stage 4 (ive.;^ the blank feeding and foldmg turret area) 
of the cigarette packaging process. These non-conformities commonly- appear on 
the cigarette package, which can be either a hard or soft pack cigarette package, as 
a tear or hole in the back corners of the lid or miter. Such tears or . holes are 
usually the resuh of the lid dust .flaps being partially .or completely, torn away. : 
One skilled in the art will appreciate that non-conformities can be created in 
several places in this area of the machine including the blank pre-bending- 
mechanism, the transfer roller assembly prior to glue being applied to the blank, 
the guides going into the blank plunger , the blank plunger, the. dust flap opener, 
and the transfer of thexigarette bundle to the folding turret. 
- ' Many of the settings in this area.of the cigarette packaging process are 
^critical and must be precise. These settings are also sensitive loythc blank ; ' 
attributes such as flatness, interlocked flaps (multiple blanks); scoring depth, and 
surface finish. It is in this area of the cigarette packaging process that the vision 
inspection system of the present invention is implemented. 

Figure 2 illustrates the vision inspection system of the present invention as 
implemented in the exemplary, cigarette packaging assembly of Figure 1. In 
Figure 2, .the vision inspection :system. of the present invention includes a digital 
camera (preferably a Keyence CV Series 6mm camera) 205, a lighting device 210, 
a camera mounting bracket 215, a modified pack guide 220 and a processor 225. 
Preferably, the digital cainera 205 is mounted, ^via:the camera mounting bracket 
215, in close proximity to the blank feeding and folding mrret area (stage 4) of the 
cigarette packaging machine^assembly.. In order to provide. the- necessary lighting 
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- - SO as to properly illuminate the blank, a lighting dwiee .21.0, such as a Stocker and 
Yale- fiber optic light source with polarizing cap; is mounted with the camera 205. 
The camera 205 and lighting device 210 are positioned so as to allow . the camera- 
to form electrical signals which, according to a preferred embodiment,' represent 
5 an image of the blank and the foil-wrapped cigarette bundle during the fabrication 
process: The pack guide 220, positioned between the camera and the folding 

turret, is modified to permit a view, of the partially constructed pack. 

> During die rotation of the folding turret,, a switch'(not shown), is triggered 
which signals the digital camera 205 . to capture the image of the forming package .^^^ 
10 Figure 3 illustrates an exemplary image captured by, the digital camera 205. The -^-: 
digital image includes an iniage of the: foil-wrapped bundle 305 and the blank 
which partially surrounds the bundle. As indicated above, the camera 205 is 
associated with the proper lighting and polarizers so as to obtain the proper light ^ 
contrast between the foil and the blank material. This allows the camera. to be able 
15 to reliably distinguish a non-conformity : According to an embodiment of the 
present invention, the camera 205 captures a.single image of the foil-wrapped ; 
bundle and partially surrounding. blank and forwards this image (i.e., the formed 
electrical signals) to the processor 225 . One skilled in the art will appreciate that 
- : the digital camera could, in the alternative, capture separate images of the sections 
20 ■ of the blank which are of greatest interest.^ : ^ : * ./ 

The three areas of the digital image which are of greatest interest to the 
present invention are the dust flaps 310 and the inside front panel (or face) 315 of 
the blank. -Figure 4.1 -illustrates an:exemplary round comer pack blank. which may 
be used in the present invention. In Figure 4.1, the outside of the pack blank is 
25 ' illustrated. One skilled in the ai't will appreciate that the. other side of the. blank 
(i.e. the inside) is white. . Figure 4.2 illustrates a square comer pack blank which 
* may alternatively be used in the present invention. In. Figure 4.2, the white inside 
of the pack blank is illustrated. . Figures 4.1 and 4.2 illustrate the locations of the 
front panel (op face) and the dust flaps on these exeniplary blanks. . 
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When the process0r.^225freceiyes thejorm.ed electrical signals from the 

camera, the processor 225 determines, based on these signals, the conformity of 
the cigarette,package. According to the preferred, embodiment, the. processor 225 
receives an image of the foil-wrapped bundle and partially surrounding blank and 
considers only those sections of the received digital image which represent the 
objects. of interest, (i.e., the dust flaps and inside front face). ,The processor 225 
compares the color (i.e., the pixel yalue) of a section of the digital image of the 
dust flaps 310 and inside front panel 3 15 to a predetermined pixel value.. In an 
image of a conforming cigarette package, the color of both the dust flaps 310 and 
inside front face 315 are white while the surrounding areas appear grey /black. 

If the pixel values of the sections of the dust, flaps 3.10 and inside front face 
315 equal the predetermined pixel value, the package is registered as conforming 
and the next package is inspected. , If the pixel value of one or both of the sections 
of the dust flaps 310 does not equal the predetermined pixel value, then this 
indicates that either one or both of the dust flaps 310 is mis-fplded or 
panially/completely missing. Similarly if it is determined that the pixel value of 
the section of the inside front face 315 does not equal flie predetermined value, 
then this indicates that the blank Js reversed. When it is determined that either one 
or more of the dust flaps 310 is mis-folded or partially /completely missing or the 
blank is reversed, the processor 225 registers the cigarette package as non- 
conforming. The processor 225 tracks the cigarette packages by tracking the 
positions thereof via, for example, assigning a number to the mdiyidual cigarette 
packages. In this manner, the; processor can simply store , a bit with the assigned 
number of a non-conforming package indicating that it is such. One skilled in the 
art will appreciate that many other methods of registering, a non-conforrning 
package exist which could alternatively: be employed. . ^ 

When a cigarette package.is registered as non-conforming, the processor 
225 sends a signal to the cigarette packaging machine indicating that the; particular 

cigarette package is to be rejected off the machine. The registered, non-. 
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conforming cigafette package is then rejected at the-pafck reject station which is 
dowiistream of the inspection station. The detection and rejection of the cigarette 
package at ^is stage of the cigarette assembly process allows for recycling of the 
cigarette bundle in tli'ose instances where' dnly the blank itself is non-conforming 
(i.e., reversed). Moreover.' the infbnriatiori'gleaned firOm the processor 
comparison aids in diagnosing problems with the' cigarette packaging machine. . 
For example, a repeated indication that the blank is reversed could indicate that a 
group of blanks were incorrectly inserted in the feeding hopper. In such an event, 
the operatbr could stop the packaging operation and correct the error, thereby 
cii-cumveriti'ng the continued application of the incorrecUy inserted blanks to the 
wrapi)ed bundles of cigarette^. ' ' . - ; . 

' ■ To further aid 'in the diagiiosis process, a computer monitor 230 and data 
iriput "device" 235, such as a keyboard, are associated with the processor 225 
thereby allowing for the display arid riianipuiation of information . Such . _l 

information could include, for example; the day and time in which non- 
conformities were detdcteci, the number of non-conformities encountered over a 
given period of time, the types of non-conformities' encountered during specific 
fieribd^ of tiriie, etc. This information would allow 'the niachine operator to 
quickly identify and remedy problems with the manufacturing process liiat 
convekioharpdst-fabrickion inspection system's cai^ • - 

Referring now to Figure 3 . 1 ; preferably the guide rail 220 includes- a 
' viewing port or notch 600 having right" and left edge portions 604, 606 which 
expose only end portions 610, 612 bf the dust flaps 310 to view by the video 
camera 205. Preferably, the inspection areas afeJimited in regions 614, 616 of 
the end portion^ 610, 612, such that'if a dust flap is missing or poorly folded, such 
as shown in Figure 3.2, the dust flap is hidden from view behind the guide 220 
■ and/or displaced sufficiently to affect "the pixel values to a cognizable degree in the 
inspection areas 614, 616. With such ari arrangement, sensitivity to dust flap non- 
conformities is increased. ' ' . '■ ' •' " . - 
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- Advantageously, the viewing port 600 is configured such tha^^ retaining 
action of the guide 220 upon the folded dust flaps 310 is not interrupted at the 
inspection station: Accordingly, the partially folded cigarette package is retained 
in its folded condition as it is moved past the viewing pon 600. 

5 Rejection of the detected nonK:onfonTiing packages may be undertaken 

downstream of the -folding turret so as tO: avoid the execution of additional 
packaging steps such as the application of cellophane and tear strips.; As a result, 
waste of materials is avoided. \ - ; - . _ 

The foregoing has described ;the principles,' preferred embodiments and 

10 modes of operation of the present invention: However, the invention should not 
be construed as being limited. to. the particular embodiments discussed above. For 
example, one skilled in the art will appreciate that the implementation of the vision 
inspection system of the present invention in a Focke 350 Round Corner, hinge lid 
packer in the above-described embodiments is merely exemplary and that the 

15 present invention is equally applicable to- other types of cigarette packaging 
* machines. Moreover, one skilled in the an will appreciate that the present 
invention is not only applicable to cigarette packaging systems, but is equally 
applicable to other types of systems where quality is desired in the packaging 
fabrication process. Thus, the above-described embodiments should be regarded 

20 as illustrative rather than restrictive, and it should be appreciated that variations 

may be made in those embodiments by workers skilled in the art without departing 
from the scope of the present invention aS; defined by: the following claims. 
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-WHAT IS CLAIMED IS::-. : — , / v-r..^;:,;' 

ir: * 1. . A system for inspecting cigarette packages, each package having-a 
pack blank comprising a plurality of rdust- flaps and an inside front. face, iaa : . 
cigarette packaging machine,- said system comprising^: t-: w :^ , . • > 

a camera for forming, prior to a cigarette package being formed, 
electrical signals representing an image of the dust flaps and the inside front face 
of the cigarette package and for outputting the electrical signals; 

' a guide for. maintaining said dust flaps. in a folded condition as said 
cigarette package is moved along a portion of said guide, said guide portion 
configured to partially expose said folded dust.flaps to said camera;, and 
• : . ^ a processor for receiving the electrical signals from the camera and 

determining based thereon a conformity of the cigarette package. 

2. The system of claim 1 wherein the processor compares an image of:, 
a section of each dust flap and a section of the inside front face to a predetermined 
image. ^ - • . , . - i . . . = . \ : ; r: 

- 3\ . ■ The system of claim. 2 wherein the comparison is a pixel color \ 
comparison. ; ^ ' ^ - 

. 4 ; - The system of claim; 1 - wherein the processor determines , by 
comparing the image to a predetermined image, if one or more of the dust flaps is 
mis-folded or partially /completely missing and if the pack blank is reversed. 

5. The system of claim 1 wherein the registering of the cigarette 
package is a transparent registering. 
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'6. The :sy stem. of :daiin:l further .com^ 
in proximity 'to the camera, for illuminating the dust flaps and inside front face. 

7. The system of claim 1 further comprising a monitor for displaying 
diagnostic infonriation. , . t ,. . . . ; - . ^ , . * 

5 8. A method of inspecting cigarette packages, each package having a 

pack blank comprising a plurality ofjdust flaps,and an inside front face, m a 

cigarette packaging machine, the methQd epinprisiiig .the steps ,of : 

retaining folded dust flaps of a cigarette package while bringing 
portions of said dust flaps into view of a camera; ; ^ 
10 forming, prior to said cigarette package being, completely formed, 

electrical signals representing an image of the dust flap portions and the inside 
front face of the cigarette package.; 

comparing the. image to a predetermined image; and 
registering, when the comparison determines that the iniage and the 
15 predetermined image are different, the cigarette package.^as non-conforming. 

' , '9. The' method of claim 8 wherein th^ .comparing st^p, further , 
comprises the step of comparing a section of each dust flap and a section of the 
inside front face.to the predetermined image. ; , . - 

' 10. ' The method of claim 9 wherein the comparing step further 
20 comprises the step of: - - l . i . 

comparing a pixel value of each section to a predetermined value. 

11. The method of clairn 8 wherein the step.of registering is a 
transparent registering of the cigarette ^package, ■ ; . 
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12 . " The method of claim 8 wherein ttret comparison step detennines 
whether one or more of the dust flips is mis-folded or partially /completely mjssing 
and whether the blank is reversed. 

13. The method of claim 8 further comprising the step of:. 
5 displaying diagnostic information. 

14. ' A system for manufacuiring cigarette packages, each cigarette , 
package having a pack blank comprising dust flaps and. an inside front face, the . .^ 
system comprising: ' - - - ' . 

a cigarette packaging machine cohiprising a folding turret; 
10 — a guide for maintaining dust flaps of a cigarette package in a folded 

condition as said cigarette package is moved along a portion of said guide, said 
guide portion configured to partially expose said folded dust flaps; 

a camera, positioned in proximity to, the folding turret and said 
' guide, for capturing an iriiagfe of one or more sections of the pack blank prior to 
15 the cigarette package being completely formed and for outputting the image; and 

a processor for receiving the image, comparing a pixel value of 
each of the one or more sectioiis to a predetermined value and registering, when 
the comparison indicates that at least one of the pixel values is different than the 
predetermined value, the cigarette package" as non-conforming. . 

20 15. The system of claim 14 wherein the one or more sections of the 

pack blank are sections of the dust flaps and the inside front face. 

16. The system of claim 15 wherein the processor determines, by 
making the comparison, whether one or more of the dust. flaps is mis-folded or 
partially /completely missing arid whether the pack blank is reversed . 



wo 00/22826 



PCTAJS99/24121 



-12- 

17. The system of claim 14 further comprising a monitor for displaying 
diagnostic information. . - 

18. A method for manufacturing cigarette packages, each cigarette 
package having a pack blankxomprising dust flaps and an inside front face, the 

5 method comprising the steps of: 

folding, via a folding turret, a pack blank around a bundle of 
cigarettes; * ' 

retaining said folded blank while, bringing portions of said blank 
into view of a camera; V 
10 capturing, during the retaining step,- an linage of at least one section 

of the pack blank; ^ ^ 

comparing a pixel value of the at least one section to a 
predetermined value; and 

registering, when the comparing step indicates that the pixel value is 
15 different than the predetermined value, the cigarette package as non-conforming. 

" 19. The method of claim 18 wherein the at least one section of the pack 
blank includes sections of the dust flaps and the inside front face. . 

20. The method of claim 19 wherein ttie conaparing step determines 
whether one or more of the dust flaps is mis-folded or partially /completely missing 
20 and whether the pack blank is reversed. 
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